• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    SUMMARY An image processing program, preferably in the form of an app (121) for a small electronic device (101) comprising a digital camera unit (103), a processor unit (105) and a memory unit (107, 109), the program comprising computer readable code is arranged to , when the processor unit causes the digital camera unit to perform the following steps: analyze an image detected by the camera lens (S33), When the image meets certain conditions, take a still image using the camera and save it in the memory unit (S35). That the image is taken automatically when the conditions are met matters the image quality. (Fig. 3)
    公开号:SE1350713A1
    申请号:SE1350713
    申请日:2012-06-15
    公开日:2013-12-16
    发明作者:Olof Hansson
    申请人:Whitelines Ab；
    IPC主号:
    专利说明:

    TECHNICAL FIELD The present invention relates to an application program, or app, as defined in the preamble of the independent claim.
    Background The use of small devices such as mobile phones that include processors is increasing rapidly. Despite this development, paper is widely used to Ora notes 10 and will Ora it for the foreseeable future. It has long been possible to scan paper documents to store their contents in data files.
    Most document scanners are quite large and are therefore stationary. On the other hand, they provide relatively uniform images of sheets of paper, since the distance from the imaging unit, the orientation of the sheet when scanned, and the light conditions can be largely controlled.
    An increasing number of small electronic devices, such as mobile phones, include digital camera devices, and the quality of these camera devices is constantly improving so that, for example, mobile phones today are in reality digital cameras.
    An application program, or app, that allows editing of images of sheets of paper taken with the help of a camera in a mobile phone was recently released by the Japanese company Kokuyo. This app is designed to let a user take a picture of a sheet of paper. Markers in the corners of the sheet are used to determine the orientation of the sheet and adjust it inside the image. Other markers may be present to indicate a folder in which the sheet is to be saved. In addition, users can add markers by color-coding predefined areas in the corners of the sheet.
    The use of markers only in the corners of the sheet limits the type of corrections that can be made to the image, and their precision. For example, a folded or wrinkled part in the middle of the sheet may not be detected at all or it may be impossible to determine the correct correction. It is also possible that parts of the text that have a very low contrast to the background can be lost during the shooting without the user being able to read from the image that something is missing.
    SUMMARY OF THE INVENTION It is therefore an object of the invention to enable more comprehensive and more accurate processing of the quality of an image of a sheet of paper.
    This object is achieved according to the invention by a sheet of paper having at least one optical marker arranged darpa, to function as was in image processing to improve the display of an image of the sheet of paper, characterized in that it has a color difference AE between the sheet of paper and the optical marker which lies between AE = 2 and AE = 18.
    For ease of identification, the optical marker or markers are preferably placed on a non-repetitive salt on the sheet.
    The color difference AE between the sheet of paper and the optical marker AE is preferably between 3 and 10. In particular, the value for AE between 5 and 8 has been found to provide an appropriate compromise between the need for good contrast and the desire to keep the background relatively light.
    The encoded information displayed on the sheets of paper enables several processing functions that allow a more user-friendly presentation of the scanned or imaged images of the sheets of paper.
    In a preferred embodiment, the sheets of paper have a background color that differs from white to white, and the optical markers have a higher degree of white than the background color of the sheet. This meant that the optically readable coded areas, or markers, were lighter than the background hue of the sheet. In this case, the coded areas will not be large notes etc added by the user of the sheet, as such notes will be in a shade that is darker than the background shade of the sheet. Many scanners and copiers have functions for adjusting the background color of the sheets to white in the images. Most digital cameras today also have features for adjusting the background color. Markers on the sheets that are lighter than the background will then become invisible so that only the information added to the sheet remains. Therefore, the notes made by the user will be more visible, as they will be darker than the background. The result is that the image taken will be an image of the notes or information on the sheet rather than an image of the sheet.
    In this embodiment, therefore, coded areas or markers can be arranged anywhere on the sheet, as reference points to enable more accurate calculations, as opposed to conventional dark coded areas, which would make notes unreadable. In the prior art, therefore, only a small part of the sheet can be used for code markers, namely the parts where notes are usually not made, typically in.
    In contrast, according to the invention, image processing can be used to make the coded areas invisible in the image. The coded areas can be used both to adjust the orientation of the image, to compensate for folded or bent parts of the image and to compensate for the fact that the sheet of paper is not perpendicular to the optical axis of the camera. It would also be possible to use lines or squares provided as a writing aid, as additional markers are allowed to provide information about the entire sheet.
    The use of only lines or squares would not work for the invention because a certain asymmetry is required to determine the raft orientation of the paper.
    Since the notes are usually darker on the gray background, the use of white markers will also help to ensure a high quality in the imaged sheet in cases where the app is arranged to check the contrast between the white markers and the gray background before taking a picture. . The fact that the contrast between the gray background and the white markers is usually lower than the contrast between the gray background and the added content also contributes to this effect. This is because in cases where the contrast between white and gray is judged to be good enough to take the picture, the contrast between the gray background and the darker content will also be good.
    In particular, the sample of coded markers can provide information to determine the size and orientation of the sheet. It can also provide information to determine how bright the paper is in different areas of the sheet and to adjust for any variations in brightness across the sheet. The additional sample of markers consisting of lines or squares can also be used to determine how bright the paper is, together with coded markers or on its own.
    Furthermore, the sample of coded markers can provide information about the type of unwritten paper used, such as the format (A4, A5, letter) and whether the paper is lined, squared, and / or provided with handwritten notes on the sheet.
    The sample of coded markers can also be designed to indicate that the sheet of paper belongs to a particular company, organization or project. This can help in indexing the images displayed, for example to ensure that they are saved in a specific file directory belonging to the company, organization or project. Based on its location in the file system, an electronically stored sheet of paper from which the markers have been removed can be automatically provided with new markers in an electronic version or in print. The format can also be used by others, for example to give all sheets in a collection of notes the same size. It would also be possible to provide a number of chips that are lighter in the background to allow a user to specify a specific folder or the like in which the imaged sheet is to be stored, depending on, for example, the project, department, etc. to which the information on the sheet belongs. The user can then place a dark ground & inside the light marking that corresponds to the folder where the image is to be saved. For example, the user can fill in the entire selection or just uncheck it. This darker ground & supplied by the user in the pre-set marking can be easily detected and interpreted by the imaging program. The markings can also be used as markers but not necessarily.
    In this document, notes added to the paper should not be construed as merely handwritten text. It can be any heist monster that is fed to the sheet. It can be added by hand, such as text, sketches, shorthand or any other combination of such monsters. Alternatively or in addition, it can be stamped, printed, typed, etc. on the sheet.
    In particular, modified versions of the paper provided by Whitelines®, as described in EP1868820, are optional for this application. It has been found that the lighter lines on these sheets are less distracting to a user taking notes on the paper. Because the lines can disappear in the loaded image, they allow digital storage of sheets with only the intended information. This facilitates digital processing including modification, deletion and additions to the notes in the image.
    The invention also relates to an imaging program for use in a small electronic unit comprising a digital camera unit, a processor unit and a memory unit, comprising computer readable code which, when crossed in the processor unit, causes the digital camera unit to perform the following steps: Analyze an image recorded by a camera lens, Identify in the image a predefined sheet of paper that has darpa, at least one coded information marker, When the image meets certain conditions, take a still image using the camera and save it in the memory device, preferably without the user's participation.
    This imaging program, which typically but not necessarily takes the form of an app, can be used to image and process a sheet as indicated above.
    Preferably, the program is arranged to detect the at least one marker in the form of atmistnone a lighter mark & on a slightly darker background, as specified above. To improve the quality of the image, it is preferable to detect more than one marker. To determine the position of the paper in 3D space, it is preferable to have at least four markers. In a preferred embodiment, the analysis step is performed on an image from a recorded video stream.
    The conditions typically include one or more of the following: The imaging unit determines that the imaged object is a sheet • The imaging unit is able to identify a certain number of coded information markers on the imaged sheet.
    The application program is preferably also arranged to cause the digital camera unit to transfer the image file to a stand-alone storage unit automatically without any instruction from the user. In this case, it may be arranged to cause the digital camera unit to transfer the image file to a certain location in the stand-alone storage unit depending on information obtained from the sheet, for example from the optical markers.
    With the application program according to the preferred embodiment, the image can be taken automatically when the quality is sufficiently good. This meant that there was no need for any user activity when the picture was taken. Such user activity usually affects the stability of the camera unit, which makes the image a bit blurry. The imaging method according to the invention therefore improves the image quality, which makes it more suitable for imaging the areas with low contrast, since there is no physical impact when the image is taken.
    Aspects of the invention also relate to an image processing program for use in a processor device comprising a memory unit and a processor unit, arranged to process images taken using the imaging program described above. This image processing program includes computer readable code which, when crossed in the processor device, causes the processor device to process an image as follows: • Detect position and / or size of at least one optical ground & on the sheet Perform image correction based on the detected position or size, the image correction comprising at least one of the following: Adjust the size of the sheet in the image Correct the orientation of the sheet in the image in a plane mainly perpendicular to the camera's optical axis. Adjust the background color of the sheet. Compensate for folds and / or curved parts of the sheet. added to the sheet.
    The step of reacting to any contents added to the sheet typically involves detecting a mark added by a user in a predefined area of the sheet, interpreting the shape and / or position of the mark and processing the image depending on the mark, for example by sanding it to a certain place for storage.
    This image processing program, which is typically but not necessarily in the form of an app, can be used to adjust the image according to one or more of the following: To align and direct the sheet in the image and / or to make the sheet fill substantially the entire image , • To provide a smooth background To remove any markers from the image so that only the added information is displayed in the image To decide whether to save the sheet in a specific location.
    The pattern of coded markers on the paper may also include a version indicator indicating a version of the paper corresponding to a particular version of the imaging program, the image processing program or both. If the version indicated by the version indicator on the paper corresponds to the version of the relevant program, this can be used as an indication of the program. Typically, if the sheet of paper has a newer version of the program, this can be used to cause the device comprising the program to update itself to the correct version of the program. If the sheet of paper has an older version of the program, this may indicate to the program that not all features of the program can be used with the current sheet.
    If a combination of markers that are lighter in the background and markers that are 3.0 darker in the background is used, the imaging program or the image processing program may have been arranged to distinguish between lighter and darker markers, which can then be used for different functions. For example, the lighter markers can be used for alignment and the darker markers can be used for information on where to save the paper.
    The invention also relates to an imaging device comprising an imaging unit, a processor unit and communication means for communicating with a computer, the imaging device comprising an application program according to a digital camera device comprising an imaging program and / or an image processing program as described above.
    The imaging device can be used in any type of digital device having a camera, such as a mobile telephony terminal, or a small computer such as a laptop, notebook or tablet. The image processing program can, of course, also be used in a digital device which does not have a camera, if the image files are transferred to such a digital device.
    Brief Description of the Drawings Figures 1a, 1b and 1c are examples of sheets of paper with markers according to embodiments of the invention, while Figure 1d shows a picture taken of a sheet of paper.
    Figure 2 is an electronic device according to an embodiment of the invention.
    Figure 3 is a flow chart of the functions performed by the imaging application program according to an embodiment of the invention. Figure 4 is a flow chart of the functions performed by the imaging application program according to an embodiment of the invention.
    Figure 5 is a histogram showing the color distribution in a sample sheet.
    Detailed Description of Embodiments Figure 1a shows a first example of a sheet of paper 11 with square markers 13 and 15 according to an embodiment of the invention. Markers 13, 15 are slightly darker than the background, which is white or almost white. This is shown as a shading of the markers. As shown, in this example there is a ground near each of the two upper corners of the sheet. Of course, all or some of the markers could be round, triangular or cloud-shaped or have any other regular or irregular shape in the stable. Different shapes could be used, for example to indicate the different positions on the sheet to facilitate image analysis. Various forms could also be used to indicate the type of paper or the intended use of the paper.
    Figure 1b shows a similar example of a sheet of paper 21 as Figure 1a, but instead of markers which are slightly darker than the background, the background is slightly colored, for example in graft, as indicated by the shading, and the markers 23, 25, 27, 29 are white or almost white. The markers thus have a lighter color on the background.
    Figure 1c shows a second example of a sheet of paper 31 with white or almost white markers on a slightly darker background, according to an embodiment of the invention. As can be seen, the markers in this example comprise a first and a second triangular ground & 33, 35 in the upper horns, and a square ground & 37 in the lower right horn. In the middle of the sheet there is another ground & 39, which has an irregular shape.
    Figure 1d shows an image taken from a sheet of paper. As can be seen, the image includes the entire sheet 41 with markers and the area around the sheet. The sheet of paper fills part of the image depending on the size of the sheet and the distance to the camera, which cannot be known or controlled precisely. According to embodiments of the invention, this can be compensated, as will be discussed below.
    In the embodiments shown in Figures 1b and 1c, the markers are inserted as a lighter field on a slightly colored paper. The background color must be quite light but can have any color, ie not necessarily graft. A degree of color difference between the markers and the background is usually defined as delta E in the (CIE) LAB space. A value of AE in the interval 6 - 7 has been found to be appropriate.
    Preferably, the background should be just so dark that the lighter markers can be detected both by a human eye and by the respective programs that can be used with the paper. The markers should be white or almost white. As mentioned above, the color difference is preferably between 2 and 18, more preferably between 3 and 10.
    Paper with standing lines or squares in a lighter shade than the background that was responsible for writing sales today under the Whitelines8 brand. Such paper has been shown to have a number of advantages over traditional paper with darker lines or squares, and the use of lighter markers to align and adjust paper also has a number of advantages. In particular, it becomes possible to remove the markers from the imaged sheet so that the imaged sheet has only dark contents on a light background. However, it would also be possible to use markers that were darker in the background, and a combination of lighter and darker markers.
    A sample of markers may vary in the number of markers used, the distribution of markers on the sheet and / or the shape of the markers. The number of markers and their distribution are preferably chosen so that they allow the application program according to the invention to determine the appropriate position, format and scale of the sheet and to adjust these in the image, and to correct in the image substantially every crease and every wrinkle on the sheet. The shape of the markers can have any suitable shape, which can be regular or irregular.
    The number of markers, their shape and their distribution can all be used to identify a particular type of paper. For example, the paper size A4 may have a different sample from A5, and lined paper may have a different sample from squared or blank paper. The number, shape and distribution of markers can also be used to identify a user, or a particular use of the paper. A special combination of geometric shape and distribution could be used to show that the paper belongs to a certain organization or a certain company or project. An easy set to achieve, this would be to add a selection with a certain shape and a certain position to a standard monster that is already am / ands for a certain type of sheet. The combination could then be used by the application program to sort the images into folders on the salt discussed below.
    The markers can also be used to indicate a version of the paper, or a desired version of one of the programs available for capturing the paper and for processing the image. This version indicator can be used to start an automatic update of one of the programs, if a newer version is available.
    It can also be used to specify for each program which functions are available for a particular sheet of paper, depending on the markers on the sheet.
    Figure 2 shows an embodiment of an electronic device 101 according to the invention. The electronic device in this embodiment is a mobile telephone having a camera 103. The device 101 also includes an image processor 105 and a program memory 107 connected to the processor 105 which has the functions for handling the camera function and possibly other functions for the device. An image memory 109 is preferably provided to save captured images. Alternatively, images can be transferred directly to a storage device in another device. The program memory includes a first program 121 for the initial processing of images from the video stream and a second program 123 for the more advanced processing of the captured still images. The functions of these programs will be discussed in more detail in connection with Figures 3 and 4, respectively. In this embodiment, both programs can be run in the image processor 105. As will be apparent from the following description, it may be appropriate to have a first image processor instead for the initial processing. of images frail the video stream and a second image processor for the captured still images. The telephone 101 shown in Figure 2 is a standard mobile telephone, which is the choice of the person skilled in the art, and its functions will therefore only be described very briefly. The telephone 101 also comprises communication units such as an antenna 111 and a signal processing unit 113 arranged to process signals transmitted and received through the antenna 111. A user interface 115 is connected to the signal processor 113 and to the image processor 105. The user interface 115 usually comprises several input and output functions. a screen, which can be a touch screen, a keyboard and / or a keypad, and possibly other input / output functions such as rust control functions. These are all elective and will not be described in detail.
    As is common in the art, the telephone 101 also has one or more communication devices 117 for communication via IR, Bluetooth or some other type of communication. Such communication devices are optional and will not be described in detail. These communication units can of course be used to transfer image files taken with the device's camera to another device. Such transfer can take place automatically or at the user's command.
    In Figure 2, the device is a mobile telephone comprising a camera, but according to the invention any type of electronic device comprising a camera can be used. For example, the device could be a PDA, a computer such as a laptop or a mini-computer, a tablet, a tablet or the like. 13 When a sheet of paper is imaged using a handheld camera, the quality can be compromised on several different Ott.
    The entire sheet may be twisted or tilted relative to the camera.
    • The sheet may be bent, creased, or wrinkled, which means that some areas are longer on / off the camera than others.
    Folded or curved areas can also make some areas of the sheet look darker or lighter than the rest.
    The distance between the camera and the sheet may vary so that the image captures some of the surroundings of the sheet, or slightly less than the entire sheet.
    The digital camera 103 can be a standard camera as found in many mobile phones and other electronic devices. On the other hand, some of the functions 107 for handling the images are specific to the invention. These functions include selecting and analyzing images from a video stream to determine if an image of satisfactory quality can be taken. Detecting markers on a sheet of paper as will be described in connection with Figure 3.
    The different types of adjustment will be discussed in connection with Figure 4.
    The camera functions 107 include an imaging application program 121 for controlling the imaging function of the camera. The imaging application program is preferably arranged to control the imaging function so that an image is taken only when the conditions are sufficiently good. If the conditions are judged to be sufficiently good, the imaging application program can be arranged to take the image automatically. The conditions can be more or less strict, from the fact that a sheet of paper can be detected to stricter conditions for the number of markers that can be detected or the detected contrast between the markers and the background. In this case, the device registers an image stream, and the imaging application program 121 has functions for determining the image quality of an image in the video stream recorded by the camera and for controlling the camera to take a still image if the quality is considered sufficiently good. These functions are illustrated by the flow chart in Figure 3. It may be advisable to include other image management functions as well, such as anti-shake functions to enhance images taken with a camera that is not completely still.
    Alternatively, the imaging program may be arranged to signal to the user that the conditions are good and to take the image only after instruction from the user. The user can also be allowed to force a picture to be taken if the camera decides that the conditions are not good enough.
    An application program 123 for image processing of the still image may be present in the electronic device 101 which is arranged to take the images. A similar application program may also be present in another processor unit, such as a computer, to process images taken by one device and efforts to the other processor unit. This application program includes functions for processing the information about the detected markers, including one or more of the following functions: Adjust the orientation of the sheet of paper so that the corners of the sheet will be in or near the corners of the image Adjust the size of the sheet in the image to compensate for variable camera distance the sheet of paper.
    Preferably, the size of the sheet of paper is adjusted so that it substantially fills the entire stored image. This causes information from outside the sheet of paper to be discarded.
    Align the sheet of paper in the stored image. This includes that the image is processed so that it shows the paper sheet as if the sheet had been substantially flat & one if it can be bent or folded. It also includes compensating for the case where the sheet is tilted relative to the optical axis of the camera lens.
    Each of these features will be discussed in more detail in connection with Figure 4 below.
    Figure 3 is a flow chart of the functions performed by the imaging application program according to a preferred embodiment of the invention. In step S31, the device camera 103 registers a video stream of the object to be imaged. This registration is preferably started by the user of the device having the camera.
    In step S32, the imaging function 121 is used to analyze an image from the video stream and determine if the object is a sheet of paper according to the invention, i.e. a sheet of paper with coded information markers. The image will look essentially as shown in Figure 1d. If so, go to the next step; if not, return to step S31.
    In step S33, the image capture function determines whether the image selected from the video stream has been found to include a sheet of paper. If so, go to the next step; if not, return to step S31. 15 1 step S34 is checked if the image meets certain conditions. When the functions 121 determine that the image meets certain conditions, the camera 103 is instructed to take a still image and save it in the memory unit 109. The conditions may be simply that a sheet of paper is detected, for example based on edge detection, but is preferably dependent on the contrast between the coded information markers and the background, ie the imaging application program is arranged to take a still image of the sheet in step S35 only if the contrast between the markers and the background is considered to be sufficiently good. The control in step S34 therefore implicitly includes a quality control.
    The camera then takes, in step S35, the still image, and saves it.
    If the still image is to be adjusted at once, the procedure continues with the adjustments described in Figure 4, starting with step S42, or the first relevant step, unless the procedure is terminated.
    Instead of a video stream, the camera can simply record the image, and a still image can be taken when the image meets the condition. It would also be possible for a user to have the camera take a picture, for example if the camera determines that the conditions are not met.
    This image could be analyzed at a later time in connection with the image processing program described in connection with Figure 4 below, to see if it is possible to Ora a meaningful image processing. The image could also be improved by known image processing techniques such as threshold treatment to improve the quality so much that image processing becomes possible.
    Steps S33 and S34 can be combined into one step in certain embodiments.
    Step S32 may include identifying a shape in the image that resembles a rectangular shape and looks like a sheet of paper. This can be done through edge detection, which is generally easier than recognizing the markers. Additionally, or alternatively, it may involve identifying one or more of the marks that should be present on a sheet of paper, which ensures that it is the right type of paper.
    Step S33 may comprise analyzing the entire sheet of paper or only one or more parts of the sheet, which includes all or a subset of the markers. As an alternative to looking in special parts of the sheet, the following steps can be performed: Reduce the image resolution to generate a layered image Identify the areas in the layered image that appear to contain markers Perform a detailed search in the identified areas to confirm the presence of markers.
    In step S35, the camera will take a still image, which will normally have a much higher quality than the images in the video stream. This means that the captured image will be of sufficiently good quality, since the video stream image has already been considered to meet some quality criteria.
    In step S35, it would be possible to take a number of pictures at the same time or at short intervals and choose the best one afterwards. Preferably, some form of user input is required after a page has been imaged to instruct the camera to return to step S31 to attempt to take a new image. This is to prevent unwanted repetitive images of the same sheet. 17 If the processor capacity is sufficiently high, theoretically every single image in the video stream can be analyzed in this way. In practice, however, a proportion of the images, typically every nth image, where n is an integer, will be analyzed, typically depending on the imaging frequency and processor capacity. For example, every fifth, tenth or twentieth image can be analyzed.
    The procedure of Figure 3 may also include a step that allows the user to transfer the captured image file to another processor unit. This is preferably achieved by using communication functions already present in the device. This can also be done automatically to a preselected device or the program may have a function for determining which device the image is to be transferred to based on the properties of the imaged sheet. The file can also be automatically sorted into a specific folder or similar depending on the characteristics of the image sheet. For example, the monster that the markers on the sheet form can identify it as belonging to a particular project, so that it should be automatically sorted into a folder for files belonging to that project.
    Figure 4 is a flow chart of the functions performed by the image processing application program according to an embodiment of the invention. These functions can be performed in parallel with step S35, or a previous image can be processed while the camera performs the method steps in S31 - S35 on a new sheet. Alternatively, the treatment can be performed after a desired number of images have been taken. The application program has information about the different types of sheets available and about the optical markers used for each type of sheet, ie the number of optical markers, their sizes and shapes, and their positions on the sheet. As will be appreciated, most of the steps are optional, so that the image can be corrected in only some of the possible ways. The order of steps S44 - S53 is also not important.
    Step S41: select image file to process.
    Step S42: determine the type of sheet to be imaged, if the sheet includes such information. Step S43: detect the presence of optical markers on the sheet.
    Step S44: detect the size of the sheet in the image, ie the proportion of the image occupied by the sheet. This can be done by detecting the edges of the paper and / or the position or size of the optical markers 18. For example, the ratio between the distance between two known markers in the image and on the seven sheets can be used to determine how much the image should be enlarged. The ratio between the size of a mark & in the image and the known size of the marker itself can be used in a similar way, as can the ratio between the size of the marker and the size of the sheet. Information contained in a bar code or a QR code or the like can also be used to determine the size of the paper.
    Step S45: adjust the size of the sheet of paper in the image, based on the size detected in step S44. Step S46: detect the angle of the sheet relative to the optical axis of the camera, ie the Z axis. This can be done by detecting the distance to markers in different parts of the sheet and the relative positions of markers on the sheet and / or depending on the edges of the sheet.
    Step S47: adjust the orientation of the sheet based on the angle detected in step S46, by tilting the displayed sheet in the image.
    Step S48: detect the orientation of the sheet in the plane that is perpendicular to the optical axis, ie the XY plane. This can be done by detecting the relative position of markers on the sheet and / or depending on the edges of the sheet.
    Step S49: adjust the orientation of the sheet based on the orientation detected in step S46, by rotating the imaged sheet in the image.
    Step S50: Depending on the optical markers, detect any creases, wrinkles or curved areas on the sheet. This can be seen depending on the positions of the markers, for example the distance between two or more optical markers which deviates from the known distance. For effective correction, a number of distances or sizes should be tacked in, representing the areas that tack the entire sheet.
    Step S51: adjust the imaged sheet for any creases or wrinkles detected in step S48.
    Step S52: adjust the background color of the sheet. 19 This can be done by a simple threshold value function in which all pixels or areas that are white or lighter are corrected to white. At the same time, all pixels or areas that are darker than the threshold value are retained as they are, or corrected to increase the contrast. It would also be possible to improve the color in each area or pixel to achieve an improved color image.
    In step S53, an analysis of significantly added content can be performed. This can be, for example, added markers in specific positions on the sheet that indicate the type of sheet or where the image is to be stored. As explained above, the sheet may have one or two light markers, in which the user may place darker markings to indicate that the sheet belongs to a particular project or the like, which may be used to automatically determine a storage location for the image and to sand the image to this storage location. .
    After this processing, the image is stored in the device and / or transferred to another unit for storage in it.
    An example of how the background color can be analyzed is shown in Figure 5. This figure shows an example of a histogram that illustrates a possible distribution of color intensity, or degree of darkness, on a sheet. The color intensity decreases along the X-axis and the proportion of the sheet that has a certain color intensity is displayed on the Y-axis. As shown in Figure 5, there is typically a top indicating the background color of the sheet. If a paper from Whitelines® is used, there is a top with a light gray color, as indicated by the word gray in the figure. There are also. a lower top indicating white, shown by the word white in the figure. Between these two peaks, the level is low because usually no part of the sheet will have a shade between the background color and the white shade. Typically, some areas will have darker shades where notes have been made on the paper.
    Noise suppression methods such as adaptive threshold values can be used to reduce noise in the image, both in the imaging program and in the image processing program.
    According to the invention, it is also possible to create histograms for one or more areas on the sheet. Due to different lighting conditions on different parts of the sheet, the background color may vary across the image. Therefore, the position of the top of the gray color in the histogram may vary. By determining the background color separately for different areas of the sheet, these differences in the background color of the image can be compensated. 21 Background Type Markers Orienteering Ring Adjusting Size Adjusting XY Orientation S53
    权利要求:
    Claims (11)
    [1]
    1. analyze an image recorded by the camera lens (S33); 2. Identify the occurrence in the image of a predefined sheet of paper having at least one coded information marker (S34), in the form of a lighter fact on a slightly colored background. under certain conditions, take a still image using the camera and save it in the memory device (S35).
    [2]
    An application program according to claim 1, wherein the analysis step (S33) is performed on an image from a registered video stream.
    [3]
    Application program according to claim 1 or 2, wherein the condition comprises one or more of the following: 1. the camera unit (103) can identify a certain number of coded information markers on the imaged sheet, 2. the image contrast between the coded information marker and the background 8 exceeds the threshold value for a certain number coded information markers ..
    [4]
    Application program according to any one of claims 1 - 3, further arranged to have, the electronic device (101) for transferring the image file to a stand-alone storage unit.
    [5]
    An application program according to any one of claims 1 to 4, further arranged to cause the electronic device (101) to transfer the image file to a certain position in the independent storage unit in dependence on information obtained from the optical 22 markers.
    [6]
    An application program according to claim 5, wherein the step of taking the image (S35) is performed without the participation of the user.
    [7]
    An application program according to any one of the preceding claims, further comprising computer readable code which, after crossing the processor device (105), causes the processor device to image process an image as follows: 1. Detect position and / or size of at least one optical ground on the sheet. image correction based on the detected position or size, the image correction comprising at least one of the following: Adjusting the size of the sheet in the image Correcting the orientation of the sheet in an image substantially perpendicular to the optical axis of the camera, Adjusting the background color bent areas on the sheet, Compensation for the sheet being tilted relative to the camera's optical axis, Atgard due to any added content on the sheet.
    [8]
    The image processing program of claim 7, wherein the step of adjusting the background color of the sheet comprises correcting all pixels or onnides that are white or light to white while retaining all pixels or areas darker than a threshold value as they are, or correcting to increase the contrast.
    [9]
    An image processing program according to claim 7 or 8, wherein the step of performing an action due to any added content on the sheet comprises detecting a mark added by a user in a predefined area on the sheet and saving the image depending on the mark. 23
    [10]
    Digital camera device comprising an application program according to any of the oceans 1-9.
    [11]
    A digital camera device according to claim 10, which is a terminal for mobile telephony, or a small computer such as a laptop, a notebook or a computer tablet.
    类似技术:
    公开号 | 公开日 | 专利标题
    KR101292925B1|2013-08-02|Object of image capturing, computer readable media for storing image processing program and image processing method
    US7633654B2|2009-12-15|Camera, computer and projector for use in sensed image projection system for projecting the image of a projection target onto a screen, and image processing method
    US9641705B2|2017-05-02|Image forming apparatus for reading indicia on a sheet and inserting images on a subsequent printed sheet at a location corresponding to the location of the read indicia
    US9384405B2|2016-07-05|Extracting and correcting image data of an object from an image
    US10455163B2|2019-10-22|Image processing apparatus that generates a combined image, control method, and storage medium
    US9779323B2|2017-10-03|Paper sheet or presentation board such as white board with markers for assisting processing by digital cameras
    CN104408427A|2015-03-11|Method and device for recognizing quadrangle of image
    JP5366699B2|2013-12-11|Image processing apparatus, image processing method, and image processing program
    JP4168957B2|2008-10-22|Image processing program and apparatus
    US10834281B2|2020-11-10|Document size detecting by matching between image of entire document and read size image
    US20100149557A1|2010-06-17|Image processing apparatus and image processing method
    JP2008284868A|2008-11-27|Printing method, printer, and program
    SE1350713A1|2013-12-16|application programs
    US9324013B2|2016-04-26|Image used commercial goods creating apparatus, image used commercial goods creating method, and non-transitory computer readable recording medium
    SE1250639A1|2013-12-16|Paper and app for digital cameras
    JPH10255024A|1998-09-25|Picture reader
    KR20170026999A|2017-03-09|Method for pre-processing image data, computer readable medium including set of commands for performing the same and optical object recognition appratus using the same
    JP6798309B2|2020-12-09|Image processing equipment, image processing methods and programs
    US11163992B2|2021-11-02|Information processing apparatus and non-transitory computer readable medium
    JP2019184319A|2019-10-24|Image formation device, image inspection device, management device, and program
    US10645256B2|2020-05-05|Image forming apparatus and non-transitory computer-readable storage medium suitable for extracting areas in images specified by handwritten marker by line marker such as highlighter pen or the like, and electronic marker by digital pen
    JP6470595B2|2019-02-13|Image processing apparatus, image processing method, and program
    CN111831846A|2020-10-27|Information processing apparatus, recording medium, and information processing method
    US20190166315A1|2019-05-30|Image reading device and non-transitory recording medium recorded with image reading program
    JP2001014455A|2001-01-19|Picture processing method, picture processor to be used for this and recording medium
    同族专利:
    公开号 | 公开日
    SE538049C2|2016-02-23|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    SE1350713A|SE538049C2|2012-06-15|2012-06-15|Application software and digital camera device for capturing paper sheets with markers|SE1350713A| SE538049C2|2012-06-15|2012-06-15|Application software and digital camera device for capturing paper sheets with markers|
    [返回顶部]